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Abstract 


For solving large sparse non-Hermitian positive definite linear equations, Bai et 
al. proposed the Hermitian and skew-Hermitian splitting methods (HSS). They re- 
cently generalized this technique to the normal and skew-Hermitian splitting meth- 
ods (NSS). In this paper, we present an accelerated normal and skew-Hermitian 
splitting methods (ANSS) which involve two parameters for the NSS iteration. We 
theoretically study the convergence properties of the ANSS method. Moreover, the 
contraction factor of the ANSS iteration is derived. Numerical examples illustrating 
the effectiveness of ANSS iteration are presented. 


Keywords: Non-Hermitian matrix; Normal matrix; Hermitian matrix; Skew- 
Hermitian matrix; Splitting iteration method. 


1 Introduction 


Many problems in scientific computation give rise to solving the linear system 
Ax = b, (1) 


with A € C”*” a large non-Hermitian positive definite matrix and x,b € C”. 
We observe that the coefficient matrix A naturally possesses the Hermitian/skew- 
Hermitian (HS) splitting 

A=H+5S, 


where 


1 1 
H=5(A+A*) and S=5(A-A\), 


with A* being the conjugate transpose of A. Bai et al. [2] presented the HSS 
iteration method: Given an initial guess 2 € C”, for k = 0,1,2,..., until 
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{x} converges, compute 
(al + H)x*+2) = (al — S)x) +b, 2) 
(al + S)c®*) = (al — H)x*t2) +, 


where a is a given positive constant. They have also proved that for any 
positive a, the HSS method converges unconditionally to the unique solution 
of the system of linear equations. 

Moreover, based on the HS splitting, Li et al. [5] presented the asymmet- 
ric Hermitian/skew-Hermitian splitting (AHSS) iteration method: Given an 
initial guess 2) € C”, for k = 0,1,2,..., until {x} converges, compute 


(al + H)x*+2) = (al — S)x +, (3) 
(AI + S)2*+) = (BI — H)xl*4®) +b, 


where a is a given nonnegative constant and ( is a given positive constant. 
They proved that if the coefficient matrix A is positive definite (Hermitian or 
non-Hermitian) the AHSS iteration converges to the unique solution of linear 
system (1) with any given nonnegative a, if 3 is restricted to an appropriate 
region. 
Bai et al. [1] recently generalized the HS splitting to the normal/skew- 
Hermitian (NS) splitting 
A=N+4+5S, (4) 


where N € C”*” is a normal matrix and S € C”*” is a skew-Hermitian 
matrix, and obtained the following normal/skew-Hermitian splitting (NSS) 
method to iteratively compute a reliable and accurate approximate solution 
for the system of linear equations (1): 

The NSS iteration method: Given an initial guess 2 € C”. Fork =0,1,2... 
until {2} converges, compute 


(al + N)x**) = (al — S)x® +, (5) 
(al + S)a*t) = (al — N)ax*+2) + b, 


where a is a given positive constant. They have also proved that for any 
positive a the NSS method converges unconditionally to the unique solution 
of the system of linear equations. 

In this paper, we introduce two constants for the NSS iteration and present 
a different approach to solve Eq. (1), called the accelerated normal and skew- 
Hermitian splitting iteration, shortened to the ANSS iteration. Moreover, 
theoretical analysis shows that if the coefficient matrix A is positive defi- 
nite (Hermitian or non-Hermitian) the ANSS method can converge to the 
unique solution of the linear system (1) with any given nonnegative a, if 6 
is restricted to an appropriate region. In addition the upper bound of the 
contraction factor of the ANSS iteration is dependent on the choice of a and 
6, the spectrum of the normal matrix N and the singular-values of the skew- 
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Hermitian, but it is not dependent on the eigenvectors of the matrices N, S 
and A. 

The organization of this paper is as follows. In section 2, we establish the 
ANSS iteration and study its convergence properties. Numerical experiments 
are presented in section 3 to show the effectiveness of our method. Finally, 
in section 4, some concluding remarks are given. 


2 The ANSS Method 


Throughout the paper, the non-Hermitian matrix A € C"*” (ie. A 4 A*) 
is positive definite if its Hermitian part is Hermitian positive definite. 
Based on the NSS iteration (5), in this paper we present a new approach 
to solve the system of linear equations (1), called the ANSS iteration, and it 
is as follows. 
The ANSS iteration method: Given an initial guess 2 € C”, for k = 
0,1,2... until {2*)} converges, compute 
(al + N)x*+2) = (al — $)x) +, 6 
leer ee 6) 


where a is a given nonnegative constant and § is a given positive constant. 

The ANSS iteration alternates between the normal matrix N and the 
skew-Hermitian matrix S. In fact, we can reverse the roles of the matrices N 
and S' in the above ANSS iteration so that we may first solve the system of 
linear equations with coefficient matrix GJ + S$ and then solve the system of 
linear equations with coefficient matrix al + N. 

Note that both af + N and 61+ S are normal matrices. Therefore, the 
linear systems with the coefficient matrices af + N and 6I + S may be 
solved accurately and efficiently by some Krylov subspace iteration methods, 
e.g. GMRES. It is known that the GMRES method naturally reduces to an 
iterative process of the three-term recurrence. See [4, 3] for other iteration 
methods about solving large sparse normal system of linear equations. 

In matrix-vector form, the ANSS iteration method can be equivalently 
rewritten as 


gkth) = M(a, B)c™ + Glo, 2)b, k=0,1,2,..., (7) 


where 
M(a, 8) = (BI + S)~'(BI — N)(aI + N)~'(alI — S) (8) 


and 
Gia, 8) = (a+ 6)(61 + 8) (eI +N). 
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Here, M(a, 3) is the iteration matrix of the ANSS iteration. In fact, (7) 
may also result from the splitting 


A= B(a, B) a C(a, 8) 


of the coefficient matrix A, with 


1 
Bla. 8) = 


Obviously 
M(a, 6) = Ba, 8)~*C(a,8) and G(a,f) = Bla, 8)". 


To study the convergence properties of the ANSS iteration and derive the 
upper bound of the contraction factor, we first represent the following lem- 
mas. 


Lemma 2.1. Let a be a nonnegative constant and 2 be a positive constant. 


If (7, ”) € 2, where QQ = [Ymin, Ymax| x [7min; Tmax Ymin > 0 and Tmin = 0, 
then 


Baa pip \ 
a,3)= max 4 ——~,—, 
Ha, B) anes { Cre) eae 
ee ee _ 
ica Sey Po. | CO YP Ae Mai - 
= (10) 
—v)2 4 72 _ 
minS7Smax | (@ +7)? + Mhrax ~ 
Proof. Let us define the function g(7) by 
(a+ 7)? +7? - 


Differentiation gives 


2n(a + B)(a— B+ 27) 
[Ce ey) sel? 


g'(n) = 


Since (a + 8) > 0, it follows that the function g(7) is an increasing function 
—a ; . eons B-a 
and is a decreasing function if y < : 


; B 
fy> 
wy 5) 
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B-a 


If 


B-a 
2 
function, and 


< Ymin, then for all y satisfying Wmin < Y < Ymax, we have 


2 
< y. So, for Yin < Y < Ymax, the function g(7) is an increasing 


fapy=. “mas a 


(6 7 a) te te 
ka ae (11) 
Ymin SYS max 


if ane 
eri} tm < 


If nin < cies then, by using 6 + a > 0, for all y satisfying Yin < 


2 
as < y, we obtain (8 — y)? < (a+), which implies that 
aor rr 24 
(ata ra <* 


Similarly, for all y satisfying ymin < y < oat we obtain (8—)? > (a+7)? 


and ; 
a <4 
(ata = 
Therefore, 
—v)2 1 2 _ 
fia, 8) = max est. if Ymin S p 7 
nin 7S 25% nmin SNS max ee rae Oe 2 


From the fact that, for ymin < y < | the function g(7) is a decreasing 
function, we can conclude that 
con?) 2? i” 
f(a, 8) = max {ati | it ann s * (12) 


= 2 ot 
Ymin <7< 45% (a + Y) “min 


Therefore (11) and (12) immediately result relation (10). 


Lemma 2.2. Let a be a nonnegative constant and DB be a positive constant. 


ip POS 


<S Ymin> where 0 < Ymin; then 


(B _ yy bs ee (6 = min)” Bz Tease (6 = Ymax)” “le Meese 


max = max ' 
Ymin SYS max { (a ad “y)? ci Hess { (a se min)? T Nias (a ot max)? Tr Ne axe } 
(13) 


Proof. Let us define the function g(y) by 


(8 = 7)? Tv ies 
(a alr “7 ar oe 


Differentiation gives 
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—2(a + B) [-7? + (B-a)y + Bat 1,05 
[(a +7)? + mraxl” 


9 (y) = 


The smallest root of g’(7) is negative and is not in the interval [ymin, Ymax|- 
The largest root of g’(7) is 


(B _ q) + V (6 7, a)? + 4(Ba + Hasse) 
2 


v1 = 


By simple computation, we can show that this root is a minimum point for 
the function g(7). Hence (13) holds and the proof of Lemma is completed. 


Lemma 2.3. Let a be a nonnegative constant and 2 be a positive constant. 


If0 <rmin < 2S, then 


Fa,8)= max, { 


(a= Ae a ea \ = (B= Ae slr Train 
ymin << 45% 


(a 7 ae + Wenn (a a nin TT Tain 


Proof. Let us define the function h(y) by 


(8 = “j)? + he 


h = 
Seal OnE OC 


Differentiation gives 


2(a + 8) [(8B-y(a+7)+min| 
[(a + qe a mind” 


W(y) = 


Since (a+ 6) > 0 and y < 8, for all y satisfying Yin < y < Ymax and 


y< — we have h’(y) < 0. Thus 
(p= Shader + ths 


f(a, 8) = (a + Ani)” a ir 


The following theorem describes the convergence property of the ANSS 
iteration. 


Theorem 2.1. Let A € C”*” be a positive definite matriz, N € C"*” be 
a normal matrix and S € C"*” be a skew-Hermitian matrix such that A = 
N+ 8S, anda be a nonnegative constant and 2 be a positive constant. Then 
the spectral radius p(M(a,{)) of the iteration matrix M(a,B) of the ANSS 
iteration is bounded by 
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fe taF (poy aa, ay 
24 2 


d(a, 8) = max 77 


SS —— max 
ajo), [ga 4 52 wtinsedw) \ (a+ 74) 


where A(N) is the spectral set of N and a(S) is the singular-value set of 
S. Let Wmin and Ymax; Nmin aNd Tmax be the lower and the upper bound of 
the real, the absolute values of the imaginary parts of the eigenvalues of the 
matriz N, respectively, and Omin, Gmax be the lower and the upper bound of 
the singular-value set of the matrix S, respectively. Then d(a,) <1 if one 
of the following conditions holds: 


(a) Any given parameter a and 8 satisfies 


max { arin a5 Pee) Oris a | 


, <BSat 2ymi 
20Ymin + AE i + Gs 20°Ymax 1 ee ar ae } _ 


(b) Any given parameter a and 8 satisfies 


a+2%min < B 


af Omax < VYmin + Tmin + 2Ymin®. 
(c) Any given parameter a and 8 satisfies 


2 2 2 2 
Cis Mmin Cmias) 20 max’Ymin 
2 2 2 x 
Ymin + “min — 7max ar 2°Ymin 


a+ 2Ymin < B < 


if Omax Z V min oF Tmin = 2Ymin@- 


Proof. By the similarity invariance of the matrix spectrum, we have 


p(M (a, B)) = p((8I — N)(aI + N)“'(al — 8)(BI + 8)~*) 
< ||(62 — N)(al + N)~*llal|(aI — 8)(8I + 8)~* 2. 


Letting Q(a, 8) = (al — S)(6BI + $)~' and noting that S* = —S, we have 


Q(a, B)"Q(a, B) = [(aI — $)(BI + 8)~*]* [(al — $)(61 + $)~*] 
= (s1 —S) ‘(al + S)(al —S)(6i +5)" 
= (al — $)(BI1 + S)"'(6I — S)"*(aI +S) 
= Q(a, B)Q(a, 8)" 


That is to say, Q(a, 8) is a normal matrix. Therefore, there exists a unitary 
matrix U € C"*” and a complex diagonal matrix /\, = diag(A1, A2,---, An) € 
cx” such that Q(a, 8) = U* N\q U. Suppose that be an eigenvalue of 
Q(a, 8) and x be an associated eigenvector, we have 
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Q(a, B)a = Ax 
(aI — S)(8I + S)~1x = dx 
(81+ S)“(al — 8)x = dx 
(aI — S)z = (BI + S)x 
If \ é —1, then ; 
—x 
Se == an (15) 
1+A 
If \ = —1, then 
(a+ B)x =0. 
Since a+ 8 > 0, it implies x = 0, and this contradicts the definition of 
eigenvector. Therefore \ = —1 can not be an eigenvalue of Q(a, 8). 

From (15), a a is an eigenvalue of S and z is an associated eigenvector. 
Since S is a skew-Hermitian matrix, its eigenvalues are pure imaginary and 
thus of the form i7;, 7 =1,...,n, where 7; € R, So 

a oe 17; 
~~ B + iT; : 


where 77; is an eigenvalue of S. Therefore 


[2 + 0% 
(Pe A ila = |0" Ae Ula (Ne le= mae (16) 
j Be +05 
Because N is a normal matrix, there exists a unitary matrix V € C"*” and 
a complex diagonal matrix A\y = diag(A1,A2,-..,An) € C”*” such that 
N =V* An V. Hence, we have 


— 7X; | 
I+ N)7\(6I-N)|l2 = ee a 
Ial+N) ‘(61 N)la = max 


= Ay ND ae 
= max ome aa (7) 
Apap tinge AN) YV (@ +95)? +05 


Now, from (16) and (17), we see that 


a? +o? — 45)? +7? 
p(M(a,8)) << max ? ax B= as)? m5 


ia me ey Be 
oj€ a(S) B? aie oF Aj= iting € ACN) (a + ye) + 15 


Then the bound for p(M(a, 8)) is given by (14). 
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B-a 


To prove (a), we note that, if 


7 < Ymax- By using 0 < (6 + a), we obtain (8 — y)? < (a+7)?. Thus, by 
Lemma, 2.1, we have 


< Ymin; then B —-a < 2 for Ymin < 


f(a,8)= max fot tas} <1, for po <Ymin (18) 


ymin <¥<max | (@ +)? + Max 2 
a? + 05 
Moreover, if 6 >a, then max —— <1, and therefore 
aj€ o(S) B 4+ ¢2 
j 


(i) if a<B<at2%mn then d(a,8) <1. 


. By using (18), we have 
aj;€ o(S 


\/a? + 05 
If 8<a,then max ——< 
) [B? + 0% 


a max (B _ 4)? + Tesi . 
B Ymin SYS Ymax (a Ir ny)? op Nese 


d(a,B) < 


So, in order to have the bound d(a, 8) < 1, the following inequality must 
a (8-7)? +wel _ 6 
SO ae Mmax 
: 19 
ce { (a+)? + “as | = a? 49) 


By using the results of Lemma 2.2, the following inequalities must hold 


(6 ~ Nites) + ais < BP and 
(Ge Vout)? eae a? 


(8 _ Weiaa\ Tv — < e 


20 
(@ + Ymax)? + Trax a? 20) 


By simple computation, we can show that, for a+ > 0, these two inequalities 
hold if 8 satisfies the following inequalities. 


a(Yein + ieee) < B and Ger + Weve) 
5 5 n ot ae 
20min + Ymin 1 max 20 max =r Ymax a Tmax 


Therefore 


2 2 2 2 
(ii) ee { OVain es Max) OYE aie us Max) \ < B < Qa 
20min a Ymin + Nnax 20°Ymax 1 ' Vmax T Imax 
then 0(a, 8) <1. 


Combining (i) and (ii), we have 


(iii) if max { a Yin of Tes) a Yrax ae Heel \ < B <at+ 
h ae + Vath ar Nias 207 max og Veni + a ~ 
2ymin then d(a, 8) <1 
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To prove parts (b) and (c), we note that, if ymin < ues by Lemmas 2.1 


and 2.3, we have 


f(a, 8) = max 


nin << 25 


{i _ ay + | = (8 = ‘Yenin )? T Mn =i, 
(a + a)? + Weis (a a ee We eae 


since (a + min) < (8 — Ymin)+ 
On the other hand, 


ae+oa 
max 
a;€ o(S) Je +o 


since a < £. So, the relation 


Sn 


_ Vv a? a Tie 
VB? + o2rax 


<1, 


SN 


a? + Chas min) ea pide 
5(a, B) = ¥ “ t el 
B? + Jf B? + Oran (a ar ‘min ) a Tmax 
will hold if a and 6 satisfy the following inequality, 
aah 42 2 2 2 
(B= “yeni )” Winnie ee eer (21) 


(a 7 Venta)” Te Week a + Ors 
For a+ 6 > 0, this inequality is equivalent to 


0< (8 _ a) (Yonin =r nia a Dae ar: 20min) + 2Ymin (a? + mae (22) 


Since (8 — a) > 0, (22) holds if omax < W72in + Min + 20min. Thus 


(iv) if Omax S eis + eee + 20min and a+ 27min < B, then 

d(a, B) <1. 
If Omax > VV2in + Main + 20min, then (22) holds if 6 satisfies the following 
inequality 


Gar au eee _ Civak + eae) 27min (a? + Cmax) 


B< 
oe =e ia Coss + 20min 


Thus 


(v) if Omax > V Yin + Teas + 207 min and 


ga + Minin = Fina ele 20 ritn) _ 22min (a? a Os) 
eae + Mei — Oaisd r 20Ymin 


a+2 ymin < B< 


then d(a,8) <1 
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Theorem 2.1 mainly discusses the available 6 for a convergent ANSS it- 
eration for any given nonnegative a. It also shows that the choice of { is 
dependent on the choice of a, the spectrum of the matrix N, the singular- 
values of S, but is not dependent on the spectrum of A. Notice that 


Gee ee) 
20 Venitn + Vain F Mean 
20 i FO in 2 ete PO oie 
- 2aYmin + Yin + Trax 


a+ 27min 


>0 


and 


Oe! Tenax) 
20max + ee Ir Nec 
_ 20% min Ymax + 2YminYonax + 2YminMnax + 207 ymax 
7 Dae a ah 


a+ 22min 


> 0, 


we remark that for any given nonnegative a the available 6 always exists. 
The bound 46(a,() of the convergence rate depends on the spectrum of N 
and S$ and the choice of a and 3. Moreover, 6(a, 8) is also an upper bound 
of the contraction factor of the ANSS iteration. 


3 Numerical Example 


In this section, we give a numerical example to illustrate the effectiveness of 
ANSS iteration. 
We consider the differential equation 


—u" + qu =f, 


on the inteval [0,1], with the constant coefficient g and the homogeneous 
boundary condition. When the finite difference discretization, for example, 
the centered difference is applied to the above equation, we get the system 
of linear equations (1) with the coefficient matrix 


qh 


A = tridiag(—1 5 ) 


,2,—-14 


is used. 


Let H = $(A+A*) and Sp = $(A— A*) be Hermitian and skew-Hermitian 
parts of A, respectively. We consider a NS splitting 


1 
where the equidistant step-size h = 
n+1 


A=N+S 
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where 
N=H+icl and S=So-—icl 


and c is a real number. We test the spectral radius of the iteration matrix 
M(a, 8) (8) with different values of gh. All the tested matrices are 64 x 64. 

In Figs. 1 and 2, we show the spectral radius of the iteration matrix of 
the ANSS method and the NSS method with different values of a. ANSS 
represents the spectral radius of the iteration matrix of the ANSS method, 
where parameter { is tested to be the optimal one, and NSS represents that 
of the NSS method. 


qh=1 qh=10 
1 1 
‘7 in * ANSS 
g \ 2 0.8) —- — -NSS 
= = = * 
308; \ - 3 *> a= 
= * 2 Feo = 0.6 *y o> 
3 0.6 \ g** 8 PKL 
[ox [om 
7) * * ANSS D 0.2 
— — —-NSS 
0.4 0 
0 1 2 3 0 2 4 6 8 10 
parameter a parameter o 
qh=100 qh=1000 
1% — oes (OEE Sg eS 
2 808 
B 0.6 mFS 3 *  ANSS 
cae Ser Nes gels — — -NSS 
3 = Kx 8 0.4 * 
B02 PAHO EEK Bool “ay 
. . + 
‘5 FAR Gekko ak 
0 10 20 30 40 a 10 20 30 40 
parameter o parameter o 


Fig. 1: Spectral radius of iteration matrices of ANSS and NSS methods for 
c=.1 


We find that if c = 0.1 is used, the spectral radius of the iteration matrix 
of the ANSS method is always smaller than that of the NSS method, and 
when qh is large, the spectral radius of the iteration matrix of the ANSS 
method is much smaller than that of the NSS method, but if c = 10 is used, 
these two spectral radius of the iteration matrices are almost the same. 
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qh=1 qh=10 
1* 1% 
‘ * ANSS ' * ANSS 
S$ 0.99} % ait — S$ 0.95 = nes 
ne} a ea ne} 
© : eh © pik 
B 0.98: * eo s 0.9} } eer" 
3 * yer* 5 % * 
ro) OK ro) \ x* 
& 0.97 & 0.85 Rye” 
0.96 0.8 
0 10 20 30 40 10 20 30 40 50 
parameter a parameter o 
, gh=100 qh=1000 
i * ANSS 
g \ — — -NSS g 
8 0.95; x yor q 
= \ = 
[oj # Ia 
5 * 5 
2 0.9 * Pol D 0.96 <* 
[om * 
2) * * Yn ¥ 5d 
ey So ¥& 
0.85 0.94 26k 
0 20 40 60 80 0 50 100 150 200 


parameter a 


parameter o 


Fig. 2: Spectral radius of iteration matrices of ANSS and NSS methods for 
c= 10 


4 Conclusion 


In this paper, we have introduced two constants for the NSS iteration and 
presented a different approach to solve the system of linear equations (1), 
called ANSS method. 

Theoretical analysis showed that if the coefficient matrix A is positive 
definite (Hermitian or non-Hermitian) the ANSS method can converge to 
the unique solution of the linear system (1) with any given nonnegative a, 
if 8 is restricted to an appropriate region. In addition the upper bound of 
the contraction factor of the ANSS iteration is dependent on the choice of a 
and 8, the spectrum of the normal matrix N and the singular-values of the 
skew-Hermitian, but is not dependent on the eigenvectors of the matrices N, 
S and A. Numerical examples illustrated the effectiveness of ANSS iteration 
and showed that the spectral radius of the iteration matrix of the ANSS 
method is always smaller than or equal to that of the NSS method. 
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